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Abstract 

Dynamic tracking of sparse targets has been one of the important topics in array signal 
processing. Recently, compressed sensing (CS) approaches have been extensively investigated as 
a new tool for this problem using partial support information obtained by exploiting temporal 
redundancy. However, most of these approaches are formulated under single measurement vector 
compressed sensing (SMV-CS) framework, where the performance guarantees are only in a 
probabilistic manner. The main contribution of this paper is to allow deterministic tracking of 
time varying supports with multiple measurement vectors (MMV) by exploiting multi-sensor 
diversity. In particular, we show that a novel compressive MUSIC (CS-MUSIC) algorithm with 
optimized partial support selection not only allows removal of inaccurate portion of previous 
support estimation but also enables addition of newly emerged part of unknown support. Numerical 
results confirm the theory. 
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I. Introduction 

Dynamic target tracking problem that addresses the estimation of time varying support of moving 
target has been one of the important classical topics in array signal processing including radar, 
communication, and medical imaging applications. For example, in electroencephalography (EEG) 
or magnetoencephalography (MEG) source localization problems, it has been shown that the 
position of the dipole moments during epileptic activities varies according to time and we are 
interested in their spatio-temporal dynamics fl). Dynamic MRI problem that tracks the motion of 
hearts also belongs to this class of problem. 

Recently, there have been renewed interests for this problem with the help of a modern math- 
ematical tool called compressed sensing O, Q. These approaches try to exploit knowledges of 
partial support information obtained at the previous time point. More specifically, consider the 
following time varying support estimation problem: 

min ||x(t)||o, subject to b(i) = Ax(t), i = 0, 1, ■■■ , (1) 

x(i) 

where b(t) G M. m , and x(t) G M n are noiseless measurement vector, and sparse signal at time t. 
Assuming that the support is assumed to change slowly, theoretical results |4] have demonstrated 
that we can reduce the required sampling in compressed sensing reconstruction if we have partially 
known support from the prior estimation results. For example, Vaswani and Lu proposed modified- 
CS algorithm [4] which addresses the exact reconstruction of noiseless case with partially known 
support: 

min ||(x(«))/( t _i)c|| , subject to b(i) = Ax(t), t = l,2,---, (2) 

x(t) 

where I(t — 1) is the previously estimated support, and (x(£))/( t _ 1 )<= denotes a subvector after 
removing the elements that correspond to the index set I(t — 1). Suppose, furthermore, k = 
|suppx(i)|o, u = \I(t) \ I{t — 1)|, and e = \I(t — 1) \ I(t)\. Then, if the restricted isometry 
constant (RIP) for the sensing matrix A satisfies 

Sk+e+u < 1, (3) 

then the solution x(£) of Eq. (0 is the unique solution [4J. This is much weaker than < 62k < 1 
for the original SMV-CS problem Q, in case of slowly time varying support with « « and 
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e <C k. They further showed an l\ convex relaxation of Eq. $2} can provide the same Iq solution 
of Eq. ((U), if the following RIP condition is satisfied: 

2^2« + hu + 5k+e-u + $l+e + ^k+e+u < 1> ( 4 ) 

which is again relaxed sampling requirement than that of original CS problem <5 2 fc < v2 — 1 
|5]. Therefore, exploiting the temporal redundancy has significant impact for reducing sampling 
requirement for dynamic support tracking. 

Rather than solving the tracking problem Eq. £[]) at each time, batch type approaches such as 
T-SBL (temporal sparse Bayesian learning) [lj collect the multiple snapshot data (for example, 
{b(t)}^ 1 ) and process them together to estimate the dynamic varying support. Note that if the 
support changes slowly over time, then the resulting collection of problem becomes an multiple 
measurement vector problem. Accordingly, T-SBL converts the resulting MMV problem into a 
block-sparse SMV problem, after which each block statistics are modeled using a specific Gaussian 
form temporal correlation structure. The update rule using the expectation-maximization (EM) 
method and its accelerated version can be then used to solve the resulting Bayesian problem (H. 

However, these approaches for dynamic support tracking is with SMV-CS framework and their 
performance guarantees is in a probabilistic sense. In practice, there are many situations where 
we can obtain multiple measurement vector information for time varying objects. For example, in 
single-input multiple-output (SIMO) multiple access channel (MAC), multiple antenna can observe 
linear combination of individual codewords multiplied by the unknown channel gain from the 
individual user [6]. In parallel MR cardiac imaging, multiple coils simultaneous obtain k-space 
measurements of temporally varying hearts with distinct coil sensitivities. In EEG/MEG source 
localization problem, the dipole moments can be assumed relatively stationary during a short time 
window from which multiple snapshot of the sensor measurement can be obtained. All these 
examples acquire multiple measurement of the unknown signal vectors that share the same support 
with different weighting through identical sensing matrices. 

A fundamental question under this setup is what kind of diversity gain we can obtain over 
SMV-CS support tracking. To our knowledge, we are not aware of any prior investigation in this 
regard. One of the main contributions of this paper is to show that a multiple measurement vector 
(MMV) framework not only extend the SMV counterpart, but also provides a unique advantage 
of "deterministic" support tracking for slow varying support estimation. Recall that MMV can 
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measure multiple information of a set of vector that share the same sparsity pattern through the 
identical sensing matrix. This paper shows that this joint sparsity pays off significantly in dynamic 
support tracking by relaxing probabilistic guarantee to a deterministic guarantee. The feasibility of 
the exact support tracking has significant impacts in practice. 

The breakthrough is based on our novel compressive multiple signal classification (CS-MUSIC) 
algorithm in MMV compressed sensing problem 0, in which a part of supports are found 
probabilistically using the conventional CS, after which the remaining supports are determined 
deterministicaily using the generalized MUSIC criterion. In addition, CS-MUSIC allows us to find 
all k support as long as at least k — r + 1 support out of any A;-support estimate are correct (H, 
where r denote the rank of the measurement matrix. This result provides an important clue for 
deterministic and exact dynamic support tracking under MMV setup, in which the probabilistic 
compressed sensing support estimation step is replaced by the support estimate from the previous 
snapshots, after which the CS-MUSIC algorithm eliminates the incorrect portion of previous time 
point support estimation and then add newly updated support deterministicaily. This update scheme 
guarantees the exact support tracking in noiseless case under an appropriate sampling condition. 
Other contributions of our method include that the support error does not propagate along time 
due to the self-correction step. Furthermore, using large system model, we can derive conditions 
with which the proposed algorithm correct track the time varying support even in noisy cases. 
We believe that with these noticeable advantages of our algorithm we may find many important 
applications in radar, communication as well as biomedical application. 

This paper consist of following. Section [TT] reviews the compressive MUSIC and support correc- 
tion criterion for MMV setup. In Section [Till we derive our main theoretical results on sampling 
condition for deterministic support tracking. Numerical results are given in Section |IVJ which is 
followed by conclusion in Section [V] 

A. Notations and Mathematical Preliminaries 

Throughout the paper, x* and Xj correspond to the i-th row and the j-th column of matrix X, 
respectively. When S is an index set, X s , As corresponds to a submatrix collecting corresponding 
rows of X and columns of A, respectively. The following definitions are also used throughout the 
paper. 
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Definition 1: |9] The rows (or columns) in W 1 are in general position if any n collection of 
rows (or columns) are linearly independent. 

Definition 2: ifTOl Spark(^4) denotes the smallest number of linearly dependent columns of a 
matrix A. 

Definition 3 (Restricted Isometry Property (RIP)): A sensing matrix A e W mxn is said to have 
a /c-restricted isometry property (RIP) if there exist left and right RIP constants < 5^ , 5^ < 1 
such that 

(l-^)||x|| 2 <Px|| 2 <(l + ^)||x|| 2 

for all x G M. n such that ||x||o < k. A single RIP constant 5k = max{6^,6^} is often referred to 
as the RIP constant. 

II. MMV Compressive Sensing using Compressive MUSIC: A Review 

Let m, n and r be a positive integers (m < n) that represents the number of sensor elements, 
the ambient space dimension, and the number of snapshots, respectively. Suppose that we are 
given a multiple-measurement vector B G W nxr , X = [xj, • • • , x r ] G M nxr , and a sensing matrix 
A G W mxn . A canonical form MMV problem Q is given by the following optimization problem: 

minimize 1 1 X \ \ q (5 ) 

subject to B = AX, 

where ||^||o = |suppX| = k, suppX = {1 < i < n : x* ^ 0}, and the measurement matrix B is 
full rank, i.e. rank(S) = r < ||-X"||o- 

Recall that every MMV problem can be converted to a canonical form MMV using a singular 
value decomposition and dimension reduction as described in [7]. Now, We can easily expect that 
the diversity due to the joint sparsity can improve the recovery performance over SMV compressed 
sensing. Indeed, Chen and Huo ifTTI . Feng and Bresler [12J and recently Davies and Elder |[T3l 
showed that X G M nxr is the unique solution of AX = B if and only if 
..,,„ spark(A) + rank(i?) — 1 , , 

||X|| < — — — — < spark(A) - 1 . (6) 

Note that we can expect rank(B)/2 gains over SMV thanks to the MMV diversity. Furthermore, 
Feng and Bresler |[T2l showed that the noiseless Z bound in Eq. © is achievable using MUSIC 
algorithm as long as r = vauk(B) = k. More specifically, suppose that the columns of a sensing 
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matrix A G W mxn are in general position. Then, according to 1121 . H3 , for any j G {1, • • • ,n}, 
j G suppX if and only if 

Q* aj = 0, (7) 

where Q G R mx ( m - r ) consists of orthonormal columns such that = so that R(Q) X = 

R(B), which is often called "noise subspace". Using the compressive sensing terminology, Eq. §7} 
implies that the recoverable sparsity level by MUSIC (with a probability 1 for the noiseless 
measurement case) is given by 

\\X\\ <m = spark^) - 1, (8) 

where the last equality comes from the definition of the spark. Therefore, the Iq bound © can be 
achieved by MUSIC bound in © when r = k Ifl2"| . 

However, for any r < k, the MUSIC condition (O does not hold. This is a major drawback 
of MUSIC compared to CS algorithms that allow perfect reconstruction with a extremely large 
probability by increasing the sensor elements m. One the other hand, even thought the conventional 
CS algorithms for MMV such as simultaneous OMP (S-OMP), p-thresholding El, HH have good 
recovery performance when r <^ k, but they exhibit performance saturation as r increases and 
never achieve the Iq bound with finite snapshot even in noiseless case. Recently, we showed that 
this drawback of the existing approaches can be overcome by the following generalized MUSIC 
criterion Q. 

Theorem 1: Q Assume that A G R mxn , X G R nxr , and B G M mxr satisfy AX = B. 
Furthermore, we assume that ||X||o = k and A satisfies the RIP condition with the left RIP constant 
< &2k-r+i < !■ If we are g iven h-r C suppX with |J fc _ r | = k - r and A Ik _ r G R mx ( fc - r ), 
which consists of columns whose indices are in Ik- r , then for any j G {!,-•• , n} \ It- r , 



P R(Q) ~ P R(PR iQ) A Ik _ r ) 



(9) 



if and only if j G suppX. 

In Q, we demonstrate that the condition < ^-r+l < ^ ^ or generalized MUSIC is equivalent to 
Iq bound which implies that a computational expensive combinatorial optimization problem is 
now reduced to |Jfc_ r | support estimation from the original \If.\ support estimation^. Furthermore, 



'When r = k, the condition l[9} is the same as the MUSIC criterion and no combinatorial algorithm is necessary. 
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by Theorem [TJ we can develop a computationally tractable relaxation algorithm called Compressive 
MUSIC (CS-MUSIC) that relaxes the combinatorial optimization step of finding I k _ r support using 
the conventional MMV-CS algorithms Q. The algorithm can be stated as following: 

• (Step 1: compressed sensing step) Find k — r indices of suppX by any MMV compressive 
sensing algorithms such as 2-thresholding or SOMP. Let Ifc_ r be set of selected indices and 

S = Ik-r- 

• (Step 2: generalized MUSIC step) For j G {1, • • • , n} \Ik- r , calculate the quantities rj(j) = 
^[PrIQ) - p R(P mQ) A Ik _ r )}^j for all j £ I k _ r . Make an ascending ordering of rj{j), j (£ I fc _ r 
and choose indices that correspond to the first r elements and put these indices into S. 

In compressive MUSIC, we determine k — r indices of suppX with CS-based algorithms such 
as 2-thresholding or S-OMP rather than Iq optimization, where the exact identification of k — r 
indices is a probabilistic matter. After that process, we recover remaining r indices of suppX with 
a generalized MUSIC criterion, which is given in Theorem [TJ and this reconstruction process is 
deterministic. This hybridization makes the compressive MUSIC applicable for all ranges of r, 
outperforming all the existing methods. Similar observation have been made independently by Lee 
and Bresler [Q/71 in their subspace augmented MUSIC (SA-MUSIC) algorithm. 

To analyze the performance of the compressive MUSIC, we should find the number of mea- 
surements with which we can identify the support of X. Due to the reduction of uncertainty from 
\Ik\ to |/fc-r|> we can expect more relaxed sampling condition. In Q, we derived the sampling 
requirements when subspace S-OMP or 2-thresholding is used as a compressed sensing step for 
compressive MUSIC. The results can be summarized as following. The number of measurements 
for subspace S-OMP for partial support recovery exhibits two distinct characteristics depending 
on the number of the measurement vectors. First, if the number of multiple measurement vectors 
r is sufficiently small, then the number of samples for S-OMP is reciprocally proportional to the 
number of multiple measurement vectors. On the other hand, we have sufficiently large number of 
snapshots such that imin^oo (log n) jr is close to 0, then the number of measurements for S-OMP 
varies from Ak to k according to the ratio of r and k so that the log n is not necessary. In particular, 
if the number of snapshots approaches the sparsity k, then we can identify the indices of suppX 
with only k measurements, which is equivalent to the required number of multiple measurement 
vectors for the success of conventional MUSIC. Furthermore, we demonstrated that the required 
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SNR for the success of support recovery can be reduced and when the asymptotic ratio of the 
number of snapshots and the sparsity level (that is, lim^^oo rj k) is nonzero in the large system 
limit, only finite SNR is required, which is significant improvement over SMV-CS. 

In the original form of CS-MUSIC, the performance is, however, very dependent on the selection 
of k — r correct indices of the support of X. In practice, even though the consecutive k — r steps 
of S-OMP may not be correct, there are chances that among the estimates of fc-sparse solution, 
part of the supports could be correct. Hence, if we have a mean to identify k — r correct support 
in any order out of any /c-sparse, then we can expect that the performance of the compressive 
MUSIC will be improved. Of course, when (, * ) is small, we may apply the exhaustive search, 
but if both k — r and r are not small, then the exhaustive search is hard to apply so that we have to 
find some alternative method to identify the correct indices from the estimate of suppX. Indeed, 
the following support selection criterion can address the problem ll8l . 

Theorem 2: flHJ Assume that we have a canonical MMV model AX = B where A G M mxn , 
X G M nxr , ||X||o = k and r < k < m < n. If there is an index set Ik C {1, • • • , n} such that 
\Ik\ = min{/c, spark(A) — r} and |1& n suppX| > k — r + 1, then for any j G Ik, j G suppX if 
and only if 

P Qk ,^j = 0, (10) 

where Q^j is the orthogonal complement for R([B Ar k \ {j}]), ^h\{j} consists of columns of A 
whose index belongs to Ik\{j} and ^ V{ } j) is the orthogonal projection on R([B Ai k \{jy\) 

In particular, if the columns of A are in general position, then we can take index set Ik with 

= min{A:,m — r + 1}. Also, if A has an RIP condition with < 62k < 1> then we can take 

= k since r < k. 

Theorem |2] informs us that we only require the success of partial support recover out of /c-sparse 
estimate, rather than k — r consecutive correct CS step Q. Accordingly, the compressive MUSIC 
with optimized partial support is then performed by following procedure. 

• [Step 1: compressed sensing] Estimate k indices of suppX by any MMV compressive 
sensing algorithm. Let 1^ be the set of indices which are taken in step 1. 

• [Step 2: support deletion] For j G Ik, calculate the quantities ((j) = \\PQ k .&j\\ 2 . Make 
an ascending ordering of C(j)» j £ Ik an d choose indices that corresponds the first k — r 
elements and put these indices into S and remove the remaining ones. 
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• [Step 3: support addition] For j € {1, • • • ,n}\ S, calculate the quantities 

V(j) = a *ji P R(Q) ~ P R{P R{Q) A lk _ r )]*j- 

Make an asending ordering of r/(j), j ^ S and choose indices that correspond to the first r 

elements and put these indices into S. 
The step 1 in the above algorithm need not to be greedy so that we can also apply the convex 
optimization algorithm such as £2,1 minimization [18] or belief propagation fT9ll . 

III. Deterministic Support Tracking using Compressive MUSIC 
A. Noiseless Cases 

In this section, we will show how the compressive MUSIC with optimized partial support can 
be used for dynamic support tracking, whose joint support suppX(t) changes slowly along time 
as illustrated in FigQ] First, we define a canonical form of dynamic MMV problem. 

Definition 4: A canonical form of noiseless dynamic MMV problem is given by set of MMV 
problem with time varying /c-sparse vectors X(t) £ M nxr that satisfies Y(t) = AX(t) as described 
in following formulation: 

min ||X(t)|| , subject to B(t) = AX(t), t = 0, 1, • ■ • , (11) 

x(t) 

where suppX(f) = {1 < i < n : x(i)* / 0} and |suppX(t)| = k(t), the measurement matrix 
B(t) is full rank, i.e. rank(f?(t)) < k(t). Here we assume that rank(£?(t)) is constant so that we 
let r := r&nk(B(t)). 

Note that the canonical form MMV has the additional constraints that the measurement matrix is 
full rank and va,nk(B(t)) = r < k(t). This is not problematic since every dynamic MMV problem 
can be converted into a canonical form using the following dimension reduction similar to Q . 

• Suppose we are given the following linear sensor observations: B{i) = AX(t) where A G 

R mxn and X £ R nxl satisfies ||X(t)|| = k(t). 

• Compute the SVD as B(t) = UD r V*, where D r is an r x r diagonal matrix, V G C lxr 
consists of right singular vectors, and r = rank(S), respectively. 

• Reduce the dimension as B S v(t) = B(t)V and Xsv(t) = X(t)V. 

• The resulting canonical form MMV becomes Bsv{t) = AXsv{t)- 
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Fig. 1. MMV problem for slowly time varying sparsity pattern. 



We can easily show that rank(Bsv) = r < k(t) and full rank and the sparsity k(t) := \\X(t)\\o = 
\\Xsv(t)\\o with probability 1. Therefore, without loss of generality, the canonical form of dynamic 
MMV in Definition [4] is assumed throughout the paper. 

For such dynamic support tracking, we can apply our CS-MUSIC algorithm. However, if the 
number of snapshots is not sufficient, the amount of support estimation that need to be done by 
CS step is significantly larger than those recovered by the deterministic generalized MUSIC step. 
Since CS step allows the support recovery in a probabilistic sense, it is more prone to error; so we 
are interested in finding a deterministic algorithm that significantly outperform the existing one. 
The following Theorem [3] shows that if we have a correct estimation for the initial support 1(0) 
of X(0) and the support changes are sufficiently small and the sparsity k(t) is fixed for all time 
point, then we can recursively identify the support of time-varying input signals in a deterministic 
manner. 

Theorem 3: Suppose a noiseless canonical form of dynamic MMV problem satisfies 

|suppX(i)\suppX(i- 1)| <r-l, (12) 

for all t = 1, 2, • • • . Furthermore we assume that r < k(t) < /c max for a positive integer k max and 
< ^2fc max (^4) < 1- Then, if we have a correct initial support estimation for X(0), then we can 
identify the correct support for all t > by applying the following procedure recursively: 
• [Initial support estimation] Let I(t — 1) be the support estimation of X(t — 1); 
. [Support deletion] Find an index set I(t) a C I(t - 1) such that I{t) a := {j € I(t - 1) : 
a j^Q(t) fcJ a i = 0}; where Q{t)k.j is the orthogonal complement for 
R[B{t),A I{t _ im} \; 
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• [Support addition] Find an index set I(t) such that 

I(t) = {j : a*[P Rm)) - P R{Pjt(QmAm J aj = 0}, where Q(t) G R™x(m-r) consists of 
orthonormal columns such that Q(t)*B(t) = 0; 

• Set k (t) := \I(t)\ be the sparsity estimate for X(t) and I(t) be the support estimate for X(t). 
Proof: See Appendix A. ■ 

In Theorem^ we assume the RIP condition < 8% k (A) < 1, instead of < 52fc max -r+i(^) < 1 - 
If we assuming the RIP condition < 5^ _ r+1 (A) < 1, when r > 1 + k mSLX — k(t)/2, we may 
have \Ik\ < k(t). However, we can modify the support deletion procedure in Theorem [3] as the 
following, under the condition |suppX(t) \ suppX(t — 1)| < k max /2. 

• [Support deletion] Find an index set I(t) a c I(t - 1) such that I{t) a := {j G I(t - 1) : 
a j^Q(t) fc j a i = 0}, where Q(t)k j is the orthogonal complement for R[B(t), Ar(t-i)\{j}] an< l 

consists of 1 + [^p] columns of -B(i). 

B. Noisy Cases 

In practice, the measurements are noisy, so the theory we derived for noiseless measurement 
should be modified. In the noisy case, when the sparsity are known a priori and does not change 
along time, we can apply the following procedure. 

• Let t = and let 1(0) be the support estimation of X(0). 

• For all t = 1, 2, • • • , do 

- Let I(t) = 0. 

- For all j G I(t — 1), calculate the quantities ((j) = \\PQ^. k aj\\ 2 . 

- Make an ascending ordering of ((j) and choose indices that correspond to the first k — r 
elements and put these indices into I(t). 

- For j G {1, • • • , n}\I(t), calculate the quantities rj(j) = a* P Rm)) - PR{P R{Q{t))Al{t) ) ^ 

- Make an ascending ordering of j ^ I(t) and choose indices that correspond to the 
first r indices and add these indices to I(t). 

- I(t) is the estimation of suppX(t) and let t = t + 1. 

However, if the sparsity changes along time, in the noisy cases, some of the steps in Theorem 
[3] should be modified as follows: 
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• [Support deletion] Set ei > and find an index set I(t) a such that I(t) a = {j G I(t - 1) : 

a*Pg( t ) fc .a.j < ei} where Q(t)kj is the orthogonal complement for R[Y(t) A/i(t)\{j}]> where 
h(t) C I(t - 1) such that 

nrank[y(t) A h{t) \ = nrank[y(t) = r + ^(t)!, 

where nrank(A) denotes the numerical rank of A. 

• [Support addition] Set e 2 > and find an index set I(t) b such that 

I(t) b = {j i m a ■ ^PR([Y(t) A W) ])^j < e 2 }, 

where an index set la(i) C I(t) a such that 

nrank[y(t) A h{t) ] = nrank[y(t) A I(t) «] =r+\I 2 {t)\. 

In this section, we derive sufficient conditions for the threshold values and signal to noise ratio 
that guarantee the correct identification of time varying support. For CS-MUSIC |7], we derived an 
expression of SNR and the minimum number of sensor elements. Even though these derivation is 
based on a large system model with a Gaussian sensing matrix, it has provided very useful insight. 
Therefore, we employed a large system model to derive a sufficient condition for the success of 
proposed algorithm. 

Definition 5: A large system noisy canonical form of dynamic MMV is defined as an estimation 
problem of /c(i)-sparse vectors X(t) £ M. nxr that shares a common sparsity pattern through multiple 
noisy snapshots Y(t) = AX(t) + N(t) using the following formulation: 

minimize ||X(t)||o (13) 

subject to Y(t) = AX(t) + N(t), 

where A G R mxn is a random matrix with i.i.d. Af(0, 1/m) entries, N = [ni, • • • , n. r ] E fl£ mxr 
is an additive noise matrix, m — > 00, k — > 00 as n — > 00 and iank(AX(t)) = r(t) < k(t) = 
\\X(t)\\o. Here, we assume that p := limn^oo m/n > and 7 = linin^oo k max /m > 0, a := 
lim n _ s . 00 r/k mSLX > exist and q < 1 — e for some < e < 1. 
Under the large system model, we have the following theorem. 

Theorem 4: Consider the large system model dynamic MMV in Definition [5] Suppose a mini- 
mum SNR satisfies 

SNR„ ln (r W ): = ^^>i + t (B( '» + : ) - ™ 

L/V 1 — 7(1 + 0) 
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where a m - m (B(t)) is the minimum singular value for B(t), \\N\\ is the spectral norm of N G R mxr 
and B(t) is the noiseless measurements, and a = linin^oo r/fc max , 7 = lim^^oo k max /m. Then, 
for the noisy canonical form dynamic MMV problem for slowly time varying pattern that satisfies 
Eq. (fT2~l) . the threshold values for support deletion and addition criterion to the correct partial 
support for X{t) are given by 

ei := (1-7(1 + «))/2, e 2 :=(l- 7 )/2. (15) 
Proof: See Appendix B. ■ 

IV. NUMERICAL RESULTS 

The first simulation is to demonstrate the performance of the proposed method to solve the 
time varying MMV problem in Eq. (fTTT ) for different number of changes in supports at each 
time. We declared the algorithm as a success if the estimated support is the same as the true 
suppX, and the success rates were averaged for 5000 experiments. The simulation parameters 
were as follows: m = 40, n = 100, r = 9, and k 6 {1,2, ••• ,30}, respectively. Elements of 
sensing matrix A were generated by i.i.d. Gaussian random variable -^=A/"(0, 1), and Gaussian 
noise of SNR = AOdB was added to each measurement vectors. At each time point, X(t) suppX ^ is 
generated by J\f(0, 1). Figf2]shows the recovery rates of time varying MMV problem using support 
tracking method for t = 1, 2, • • • ,5 when the number of changed supports are 4, 6, 7, and 8 at 
each time point for Fig|2a)~(d), respectively. We used CS-MUSIC algorithm with S-OMP and 
then applied optimized partial support selection at t = 1, and time varying supports are estimated 
by support tracking method recursively from t = 2 to t = 5. In Figf2l we can observe that the 
performance gracefully decreases as the number of changes in supports increases. An interesting 
observation is that the performance of the proposed method rather improves over time in FiglUa) 
and (b). However, the recovery ratio is getting lower but converges over time when the number of 
changes in supports is close to the upper bound r — 1 for perfect recovery in noiseless case. 

Next, we applied the proposed algorithm to target tracking problem in 2D image and compared 
it to MUSIC algorithm. The first row of FigfJ] indicates the original targets moving toward the 
direction of red arrows over time. Each column (from left to right) indicates the sampled image 
at t = 1,13,27, and t = 41, respectively. The simulation setting is the same with the previous 
one except m = 50, n = 900, t = 1,2, •• • ,45, and each target have a chance to move with 
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Fig. 2. Recovery rates of time varying MMV problem using support tracking method when m = 40, n = 100, r = 9, 
SNR= 40dB, and t = 1, 2, • • • ,5. The number of changes in supports at each time point is (a) 4, (b) 6, (c) 7, and (d) 
8. 



probability of at each time point. The number of target k is 24. Here, we considered the 

number of measurement vectors is 50 in the resting state, and used MUSIC algorithm to find 
supports at t = 0. The second and third row of Figj3] indicate the results of support tracking 
method and MUSIC algorithm, respectively. Note that the proposed method successfully follows 
the movement of original targets. 

V. CONCLUSION 

This paper expanded the sparse recovery with partially known supports in single measurement 
vector problem to multiple measurement vector problem with joint sparsity and proposed the 
support tracking algorithm to recover the slowly time varying supports. It is based on the recently 
developed compressive MUSIC algorithm with optimized partial support selection. The estimated 
supports at previous time can be used in optimized partial support selection to recover partial 
supports at current time and it can be used in generalized MUSIC criterion to find remaining 
supports. We also provided the maximum allowable number of changes in supports with support 
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t=0 



t=13 



t=27 



t=41 



Reference 



Support 
Tracking 1 
Method 



MUSIC 



Fig. 3. The results of the target tracking problem in 2D image when m — 50, n — 900, k — 24, and SNR= 40dB. We 
set r = 50 when t — 0, and r — 9 for t > 0. The first row indicates the original targets moving toward the direction of 
red arrows over time. The second and third row indicate the results of support tracking method and MUSIC algorithm, 
respectively. Each column (from left to right) indicates the sampled image at t = 1, 13, 27, and t — 41, respectively. 



tracking algorithm for exact reconstruction in noiseless case. Numerical results demonstrated that 
the proposed algorithm reliably reconstructs the time varying supports for various level of changes 
and successfully solves the target tracking problem in 2D image. 

Appendix A 

Proof: We only need to show that if we have a correct support for X(t — 1), then we can also 
obtain a correct support estimation for X(t) by the support selection criterion and the generalized 
MUSIC criterion. By the assumption, we have m > 2A; max > k(t — 1) + r so that if we have 
|suppX(t) n I(t — 1)| > k(t) — r + 1, then by Theorem[2]we have for any j £ I(t — 1), 

j £ suppX(t) if and only if a*P Q ( t ) fc ^ = 

where Q(t)kj is the orthogonal complement of R([Y(t) Ar(t-i)\{i})- Since we have a noiseless 
MMV problem with slowly time varying pattern, we have |suppX(i) \ suppX(t — 1)| < r — 1 so 
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that we have |suppX(i) n I(t — 1)| > k(t) — r + 1 and we can identify the correct partial support 
of X(t) which has at least k(t) — r + 1 elements. Then, if we let I(t) a be the set of indices such 
that 

l(t) a = {jel(t-l): a *P Q{t)k . aj = 0}, 

we have I{t) a C suppX and R([Y(t) Am.]) C R(A Bupp x(t))- n tne other hand, if we take a 
set I(t,r) C I(t) a C suppX such that \I(t,r)\ = k(t) — r, we have 

R([Y(t) A m .]) D R([Y(t) A I{t>r) ]) = R(A suppX(t) ) 

which implies R([Y(t) A I(t)a ) = R(Y(t) A I(t , r) ). Since < 6 2k[t) _ r+1 (A) < 5 2femax _ r+1 (A) < 1, 
we can apply the generalized MUSIC criterion with I(t,r) C suppX where \I(t, r)| = k(t) — r. 
For j G I(t,r), we can easily see that 



P R(Q(t)) ~ P R(PHlQ(t }) A I(t)a ) 



*7 = a j p fl([^ A I(t) .])J-aj = a *j P R([Y A nt , r) ])±aj = 0. 



On the other hand, for j £ I(t, r), by the generalized MUSIC criterion, we have j G suppX(i) if 
and only if 



P R(Q(t)) ~ P R{PR {Q{t)) A I(t)a ) 



P R(Q(t)) ~ P R(Pn(Q( t »A 1(t ^ ) 



a, = 0. 



Since I(t, r) C suppX, we have j G suppX if and only if 



a i 



P R(Q(t)) ~ P R(P RlQW)Ama ) 



a, = 0. 



Hence, |J(t)| = and J(t) = suppX(i). ■ 

Appendix B 

Proof: Here, we let £>(i) = AX(t), a m i n (B(t))(or a m - m (B(t))) be the minimum (or the 
maximum) nonzero singular value of B(t). Then Y(t) = B(t) + N(t) is also of full column rank 
if \\N(t)\\ < a min (B(t)). By Q, for such an N(t), we have 

llp p „ 2[a max (i?(t))+a min (ij(t))]||iV(t)|| 

By the projection update rule, we have 

P R([B(t) A Il(ma} ]) = P R(A IlWxa} ) + P R(P^ Aii{ma}) B(t)) (17) 



17 



and 

P R([Y(t) A/ lW \«>]) = P R(A Il(t)Xij} ) + P R(P^ Ali(t)X{]}) Y(t))- (18) 

Since [B(t) Azi(t)\{i}] and [Y(t) ^-h(t)\{j}] WQ of full column rank, by applying (fT71) and (fT8l) as 
done in ifTTl . we have 

\\ P R([B(t) Ax lWU , } ]) - P -R([yW A ll(m{ji ])\\ = \\ P R(P± Ah(tm . }) B(t)) ~ ^(P^^ , }) y(i)) II 

< ll-PR(B(t)) - -PR(y(*))ll- (I 9 ) 

Then for any j G -Zi(i) \ suppX, we have 



a *j P R([Y(t) A Il(m{]} ]) a j ~ a *j P R([B(t) A Il(t)v{:l} ]) a i 



P R{[Y(t) A limyy }) P R([B(t) A llimu} ]) 



a 3 (20) 



" 3 £Zx^ P ^ ^w\«>]) a i-i^ n ll a ill 2 ll P W*)) _jP WO)ll- 
Here, for each 1 < j < re, ?re||aj|| 2 is a chi-square random variable with degree of freedom m so 
that we have by Lemma 3 in |20], lim n _Kx, maxi<j< ra || 2 = 1 since lim n (log n)/m = 0. Further- 
more, for any j $ suppX, a, is independent of P^ ([y(t) Al(t _ 1)Uj}]) , so that ma*P^ ([y(() A, l(m{j} ]) a i 
is a chi-squared random variable whose degree of freedom is at least m — k(t) — r + 1 since 
P R([Y(t) A! (f) \{ } ]) * s a P r °j ec ti° n operator onto the orthogonal couplement of R([Y(t) 4/i(t)\{j}])- 
Since linin^oo (log (re — k(t)))/(m — k(t) — r + 1) = 0, again by Lemma 3 in |20], we have 

iim — r-r > 1 

n->oo m — k(t) — r + 1 

so that 

lim min a*Pm vm A n a, > 1 — 7(1 + a) (21) 

since /c(i) < fc max for all i = 0, 1, • • • . On the other hand, if we use the definition of SNR m i n (Y(i)) 
and the definition of the condition number of B(t) on (fT6l). i.e. K,(B(t)) = (<r max (B(t)))/(a m i n (B(t))), 
we have 

2(«(g(t)) + l) l- 7 (l + q) 

IliVw) " p R(Bm II < SN R mm (y(t)) - 1 < 2 ' (22) 

by the condition (fT4l) . Combining d20l) , (|2TI ) and (l22l . we have for any suppX, we 

have 

a*P^ a - 1 -^ 1 + a ) 
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On the other hand, for j G I(t— l)nsuppX(f), we have a*P^ B ^ Ai } ]) a i = by the support 
selection criterion. Then, by the similar reasoning as above, we have for any j G I\{t) nsuppX(t), 
we have 

* p ± 1-7(1 + 0) 

a j^i?([y(t) A Il(tmj} ]) a j < 2 • 

This completes the proof for the threshold values for support selection criterion. The proof for 
the threshold values for generalized MUSIC are the same except that ma*P^ Y ^ Ai (t) ^&j is a 
chi-squared random variable whose degree of freedom is m — k(t) for j ^ suppX(t). ■ 
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